"The highlighted tokens are primarily Japanese grammatical particles, auxiliary verbs, and common function words that serve to connect, modify, or clarify relationships between content words in sentences. These include particles marking case, topic, or conjunctions, as well as verb endings and polite forms, which are essential for sentence structure and meaning in Japanese."
Score Type | Accuracy | Precision | Recall | F1 score | TPR | TNR | FPR | FNR |
---|---|---|---|---|---|---|---|---|
detection | 0.68 | 0.95 | 0.38 | 0.543 | 0.38 | 0.98 | 0.02 | 0.62 |
fuzz | 0.67 | 0.815 | 0.44 | 0.571 | 0.44 | 0.9 | 0.1 | 0.56 |